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Chapter I The Mairix 



A zero matrix (Definition 7) acts as an additive identity in the set of matrices of 
the same size. What matrix is a multiplicative identity? 

If the matrix I is a multiplicative identity, IB = B. If B is m x //, then I must 
have m columns for multiplication to be defined, and I must have m rows for the 
product IB to have m rows. Thus the condition IB = B forces I to be a square 
matrix. 



Example 19 



Let B be a 2 x 3 matrix, and l : = ^ j. Then 



0 



0 

1 



An 



A,: 



b 2K 



so thai I : B = B for every 2x3 matrix B. The product BI : is not defined since B 
has three columns. However. 



1 0 
0 I 
0 (J 



0 
0 



-ft: 



Identity Matrix 



Definition 11 

Ann x h matrix with the property that (/,, = land</„ = Ofor/ ^ 7 is called 
an identity matrix. I,. When the context makes the size of I clear, the 
subscript is omitted. 



A zero mairix. like the number 0, also has special properties related to multi- 
plication. For example, if defined, a product in which one factor is a zero matrix 
always produces a zero matrix. 



Example 20 

r 0 0 0 
[o 0 0 

In this case 0 : . y A }€l = 0 : , : . The matrix A,, : 0, , ; can also be calculated and 
the result is the zero matrix. 0 ?v ,. ■ 

One property of the real number 0 does not carry over into the matrix setting 
If the product of two real numbers is 0. we can conclude that at least one of tht 
factors is 0: that is. ab = 0 implies either a - 0 or h = 0. There is no suet 
property in matrix multiplication. 
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Our nexi result is the multiplicative analogue of Theorem 1.2, but the reader 
should note that it applies only in the case of square matrices. 

Theorem 1.8 

There is a unique n x n matrix M with the property that, for every n x n matrix A. 
AM = A- MA. 

Proof 

Consider the /i x n matrix 

I 0 0 ... 0 1 
0 1 0 ... 0 
M= 0 0 1 ... 0 



0 0 0... I 

More precisely, if we define the Kronecker svmbol t„ bv 



I 11 / = J\ 

0 otherwise. 



then we have M = [£„]„., r l\A = then [AM] t} = £>„^ = a tJ . the last 

equality following from the fact that every term in the summation is 0 except that 
in which k = j % and this term is a tj \ = a^. We deduce, therefore, that AM = A. 
Similarly, we can show that MA = A. This then establishes the existence of a matrix 
M with the slated properly. 

To show that such a matrix M is unique, suppose that P is also an /; x ;/ matrix 
such that AP = A = PA for every n x n matrix A. Then in particular wc have 
MP = M = PM. But, by the same property for M* we have PM = P = MP. Thus 
we see that P = M. □ 

Definition 

The unique matrix M described in Theorem 1.8 is called the n x n identity matrix 
and will be denoted by /„. 

Note that/,, has all of its 'diagonal' entries equal to I and all other entries 0. This 
is a special case of the following important type of square matrix. 

Definition 

A square matrix D = [djj] nitn is said to be diagonal if d i} = 0 whenever / ^ j. Less 
formally, D is diagonal when all the entries off the main diagonal arc 0. 



EXERCISES 



1.19 HA and B arc n x n diagonal matrices prove that so also is AB. 
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THE 2 x 2 MATRICES 



(Ch. 1 



Perhaps more interesting arc the products 



unci 
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0 
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0 
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0 
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o 
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1 
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0 
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0 




0 


0 



- 0 



7* 0. 



Note several things about the product of matrices: 

1. If A, B arc in M 2 (U)< then Aft is also in MM). 

2. In yVf 2 (R), it is possible that AH = 0 with A * 0 and B * 0. 

3. In M 2 (!R), it is possible that AB * BA. 

These last two behaviors both run counter to our prior experience with 
number systems, where we know that 

2'. In R, ah = 0 if and only if a = 0 or b = 0. 
3'. In R, ah = /;« for all a and />. 

Here (2') is, in effect, the cancellation law of multiplication for real 
numbers: 

If ah = 0 and a * 0. ///<-/t b = 0. 

Thus (2) says that 

77k' cancellation law of multiplication does not hold in /V/ 2 (R). 

At the same time, cancellation is possible in ,-V/ 2 <R) under certain cir- 
cumstances, as we observe in Problem Similarly, (3') says that real 
numbers commute under multiplication. Thus (3) says that 

Matrices in iV/ : (R) do not necessarily commute under 
multiplication. 

Matrices in ,l/ : (R) satisfy the associative law that 
(AB)C = AlBC) 

as you can see by multiplying out the expressions on both sides of the 

equation. We leave this as an easy, though tedious exercise. 

A matrix that plays a very special role in multiplication is the matrix 



Sec. 1.2) 



DEFINITIONS AND OPERATIONS 



/ = 



1 0 

0 1 

the following properties 
b I 1 



. This matrix is called the identity matrix, because it has 



AI = 



a 

c 



][; ?1 



Similarly, 
I A = 



a ■ 


1 


+ h 


• 0 


a 


• 0 + 


b ■ 


1 




a 


b 


c ■ 


1 


J. 

t 


• J 


• 0 


c 


0 + 


d • 


1 




c 


d 


1 


0 




a 


b 
















0 


1 




c 


d 
















1 • 


a 


+ 0 


' c 


1 


h + 


0 • 


d 




a 


b 


0 ■ 


a 


+ 1 


• c 


0 


■ b + 


1 • 


d_ 




c 


d 



= A. 



- A. 



Thus, multiplying any matrix A by / on either side docs not change A at 
all. In other words, the matrix / in M 2 iVt) behaves very much like the 
number 1 does in R when one multiplies. 

For every nonzero real number*/ we can find a real number, written 
as a' 1 = such that aa 1 = 1. Is something similar true here in 
the system A/ 2 (R)'. > The answer is "no/* More specifically, we cannot 
find, for every nonzero matrix A. a matrix A 1 such that AA 1 = /. 

1 0 



Consider, for instance, the matrix A 
B = 



0 0 



Can we find a matrix 



e 



f 
h 



such that AB = /? Let's see what is needed. What we require for 
AB — I is that 



1 0 


= AB = 


I 0 




/ 




~e f 


0 1 


0 0 








0 0 



This would require that e - I, / = 0 and the absurdity that I = 0. So 
no such B exists for this particular A. Let* s try another one, the matrix 



wc can find a matrix B = 



where the result is quite different. Again wc ask whether 

such that AB - I. Again, let's see 



h 



what is needed. What is required in this case is that 



THE 2 x 2 MATRICES 



[J °] = AB " [o 

This requires that g - 0, // = J , e = I , / = - ! , so that the matrix 

does satisfy AB = /. Moreover, this matrix B also satisfies the equation 
BA = /, which you can easily verify. 

We have seen that for some matrices A we can find a matrix B such 
that AB = BA = /, and that for some /4 no such B can be found. We 
single out these "good" ones in our growing terminology. 

Definition. A matrix A is said to be invertible if we can lind a matrix 
B such that AB = #/t = /. 





~e f 











e + g f+h 
H h 



A matrix A which is not invertible is called singular. If A is inver- 
tible, we claim that the B above is unique. What exactly does this mean? 
It means merely that if AC = CA = / for a (possibly) different matrix 
C\ then B = C. To see that /Afl = /M = / and /tC*= G4 = / imply 
that 5 = C\ just equate AB = AC and cancel A by multiplying each 
side on the left by B . We leave the details as an exercise. You will have 
to use the associative law tor this (see Problem 3). 

If A is invertible and AB = BA - / as above, we call B the inverse 
of A and in analogy to what we do in the real numbers, we write B as 
A 1 . We stress again that not all matrices are invertible. In a short while 
we shall see how the entries of A determine whether or not A is invertible. 

We now come to two particular, easy-looking classes of matrices. 



Definition. The matrix A = 



a 0 
0 d 



is called a diagonal matrix. 



Definition. The matrix A = 



a 0 
0 a 



is called a scalar matrix. 



So a matrix is diagonal if its off-diagonal entries are 0. And it is a 
scalar matrix if. in addition, the diagonal entries are equal. 

Let A = q ^ b e a sca ' ar matrix. Then, if we multiply any 
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Matrix Algebra 



in general, one may not cancel the matrix C in an equation 
AC = BC.) 



1 -3 Elementary Matrices 

Objective 

Introduce the conceot of an 
liiftrnenTar-/ .'riairu or hrat, second, 
.jnd fhrrd ?\nt:n. 



This section will be devoted to the introduction of the identity matrix 
and the elementary matrices associated with it. These matrices play 
a significant role in applications discussed later in this chapter. 

Let A be an n x n matrix. We say that A is a square matrix of 
order n. We sometimes denote such a matrix by A n to emphasize 
the dimension. The entries a n (i = 1,2,..., n) are called the ele- 
ments of the main diagonal of the matrix A n . 



Definition 1-6 The matrix I n defined by 

The ;den'i:y main/ of order //. 

/„ = (<V 



where S i; . is the Kronecker delta, is called the Identity matrix of 
order n. 

We may describe I n by saying that all the entries of its main diago- 
nal are l while all other entries of I n are 0. Thus, 



I 0 0' 

0 l 0 
0 0 l 



-l 


0 


0 


0" 


0 


! 


0 


0 


0 


0 


l 


0 


_0 


0 


0 


I _ 



and so on. 

Let A be a 2 X 3 matrix. Then we have 



Al,= 
and 



't:i 



.</. M a..., 



I 0 0 
(J I 0 
L0 0 U 



Thus, the effect of multiplying the matrix A by an identity matrix 
/ (of proper order) from the left or from the right is to leave A un- 
changed. 

It follows from the definition of matrix multiplication and the defini- 
tion of the identity matrix / that we have 



BI n = B 
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1.3 Elementary Matrices 



and 

1 B = B 

171 

for every m x n matrix B. 

In the following examples we shall examine the effect of multiplying 
a given matrix A (from the left) by special matrices derived from the 
identity matrix /. 



1a;iih|»1c i 



Let 

"1 4' 

2 5 

l_3 6. 

Find LA. 



A = 



and 



E = 



oo r 
o i o 

10 0 





"0 


(f 


"1 


1 


4" 




"3 


6" 


EA = 


0 


1 


0 


2 


5 




"> 


5 




J 


0_ 


J) 


3 


6_ 




_1 


4_ 



A close examination of the resulting matrix shows that one gets 



the matrix 



Ll 4j 



from the matrix 



1 4" 

2 5 

.3 6. 



by interchanging the first 



and the third rows. Also, one can easily see that interchanging the 
first and the third rows of produces the matrix E. Thus, we may 
think of E as a "row changer" when it multiplies a matrix A from 
the left. This leads to the following definition. 



Eleriifcriu-K 



Definition 1 -7 

r.atro: ol the liri*.: kuicJ 



We call E an elementary matrix of the first kind if £ is obtained from 
the identity matrix f n by interchanging any two of its rows. 

An important property of an elementary matrix E of the first kind 
is illustrated in the next example. 



I'.v.impU' 2 



Let 

'1 4 

2 5 

.3 6J 

Find E(EA). 



A = 



and 



I 0 0" 
0 0 I 
L0 1 a 





"I 


0 


uii"i! E(EA) = 


0 


0 




.0 


J 



"1 0' 
0 0 
.0 1 



1 4 

2 5 

3 6J 
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3 above.) In general, the matrix I n —Jhe n *n diagonal matrix | 

with every diagonal entry equal to 1 — is called the identity f 

matrix of order n and serves as the multiplicative identity in | 

the set of all n x n matrices. | 

Is there a multiplicative identity in the set of all m x n ma- | 

trices if m * ri> For any matrix A in M mx/! (R), the matrix I m is I 
the left identity {I J. = A\ and I n is the right identity {AI n = 

A). Thus, unlike the set of n x n matrices, the set of nonsquare 1 

m x n matrices does not possess a unique two-sided identity, J 

because I m *I n if m *n. \ 



Example 20: If A is a square matrix, then A 2 denotes the 
product AA 9 A 3 denotes the product AAA, and so forth. If A is 
the matrix 



shows that A 2 = Multiplying both sides of this equation by 
A yields A z =—A> as desired [Technical note: It can be shown 
that in a certain precise sense, the collection of matrices of the 
form 




show that j4 3 =—A. 



The calculation 





where a and b are real numbers, is structurally identical to the 
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Linear Equations 



We define <\, to be 



j U iff - J. 



16) 



This useful symbol is known as the Kmnecker delta. We shall 
use it here to coiistruet the n-tli order square matrix /„ = | So |. 
The matrix /„ is called tin* /i-lh order identity matrix. It is a 
diauonal matrix with l\s in the main diagonal. Usually all 
matriees under consideration are of the same order, or the 
order of /„ is known from context Thus, usually we shall 
simply write* / for the identity matrix. If A is an /// X n matrix, 
then /„,A — A and A/„ = A. It is easily seen from the defini- 

in o 

tions that V i\ k u Ul - a ii% and V a lk o ki = da. In particular, if 

A is a square matrix and / is an identity of the same order, 
then /A = A/ - A. 

Let A- H. and ( ' he square matrices of the same order such 
that Art - / and CA /. Then C - (.7 = C(A« ) - iCMIi = 
IB - H. ti is called a ri'-dit inverse of A, and C is called a left 
inverse of A. We ha\e shown that if A has both a rijiht inverse 
and a left inverse, then the left inverse and ritjhl inverse are 
identical and that the riuht inverse is also a left inverse. If 
.A and /> are square matrices of the same order such that 
A/> HA - /. ihen /> is culled an inrerse of A. The argument 
above shows thai a matrix cannot have two inverses. We could 
consider one to be a left inverse and the oilier to be a riuht 
inverse and show they are identical. Thus, we shall speak of 
thr inverse ol a matrix A and denote it by A Since AA 1 " 
A 'A /, A is also the inverse of A \ Later (Section l~ b l we 
will be able to nIiovv that if A and li are square* matriees of the 
same order such that A/i ~- /. then H.\ - I. 

Matrix notation allows us to express the* svstcm ol equa- 
tions 'l..'>< in extremely compact form. Let A he the m x m 
matrix whose elements are the coefficients appearing on the 
left side of i l,'5>. That is. let 



• (t. 



A - 



• 1.17- 




LINEAR ALGEBRA 



Hans Schneider 



it* 




f. 




Copyright 1968 by Holt, Rinehan and Winston, Inc. 
Copyright <£> 1973 by Hans Schneider and George Phillip Barker 
All rights reserved under J*San American and International Copyright 
Conventions. 

Published in Canada by General Publishing Company, Ltd., 30 LcsniilJ Road, 
Don Mills, Toronto, Ontario. 
Published in the United Kingdom by Constable ami Company, Ltd. 

This Dover edition, first published in 1989, is an unabridged, slightly corrected 
republication of the second edition { 1973) of the work originally published by Holt, 
Rinchart and Winston, Inc., New York, in 1968. 

Manufactured in the United Slates of America 

Dover Publications, Inc.. 31 East 2nd *Slreet, Mineola, N.Y. 1 1501 

Library of Congress Cataloging-in-Publicalion Data 

Schneider, Hans 

Matrices and linear algebra / Hans Schneider, George Phillip Barker, 
p. cm. 

Reprint. Originally published; 2nd ed. New York : Holt, Rinchart and 
Winston, 1973. 
Includes index. 
ISBN 0-486-66014-1 

I. Algebras, Linear. 2. Matrices. I. Barker, George Phillip. 11. Title. 
[QAI84.S38 1989] 

512.9'434— dcl9 89-30966 

C1P 



THE ALGEBRA OF MATRICES 



In Fn.n we have a special matrix, called the identity matrix. 

e\\ en ei„ 



In = 



defined by 



0 if / A j 
X if / * /. 



For example. 



~1 


0 


0 


0 


0 


I 


0 


0 


0 


0 


1 


0 


0 


0 


0 


I 



In has the property that for any A in F« *, 

I n A - A - ^/«. 

We note in passing thut if B is in Fn. t «, 

IJB « 8 and » A 

and that for any scalar «, 

(«/„,)/? «■ aB aud #(a/„) » afl. 

Recall that for any number x 0, there is a number .y - 
the multiplicative inverse (or reciprocal) of x, such that 

xr- « = I. 

This situation does not hold in Fn.n, however. For let 
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